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the  initial  control  is 
while  the  outer  solu- 


ABSTRACT 

Singular  perturbation  theory  is  applied  to  obtain  the 
asymptotic  solution  for  nearly  singular  optimal  control  of  a 
constant  linear  system  in  a  finite  time  interval.   In  the  limit 
as  the  control  cost  is  reduced  to  zero, 
found  to  have  an  impulse-like  behavior, 
tlon  yields  a  singular  arc. 

INTRODUCTION 

O'Malley's  paper  at  these  proceedings  discusses  several 
examples  of  nearly  singular  optimal  control.   The  cases  where 
all  components  of  the  control  are  equally  'cheap',  and  unbound- 
ed, can  be  incorporated  within  the  fram.ev/ork  of  the  theory  for 
the  constant  linear  regulator  sketeched  in  the  following  para- 
graphs.  A  more  detailed  treatment,  using  a  preliminary  trans- 
formation to  canonical  form,  is  given  in  a  forthcoming  paper 
(O'Malley  and  Jameson,  197^. 


Consider  the  constant  linear  system 

X  =  Ax  +  Bu  ,    x(0)  specified. 


(1) 


where  the  n  dimensional  vector  x  represents  the  state,  and  the 
r  dimensional  vector  u  is  the  control.   Let  u  be  chosen  to 
minimize 

T  e 


J  = 


rp  ?  T 

(x  Qx  +  e  u  Ru)  dt 


where  Q  is  a  nonnegative   definite  constant  matrix,  and  R  is  a 
positive  definite  constant  matrix.   Then 


u  =  - 


1   -IT 
-^2  R   B  p 


(3) 


where  x  and  p  satisfy  the  Hamiltonian  equations  (Bryson  and  Ho, 

1969)        2-     2       -1  T 

c  X  =  c  Ax  -  BR   B  p  ,    x(0)  specified 


T 
p  =  -  Qx  -  A  p 


p(l)  =  0  . 


(4) 


We  shall  examine  the  asymptotic  behavior  of  the  solution  as 
e  -»■  0.   The  system  of  equations  ('I)  is  singularly  pei'turbed 
because  its  order  is  reduced  from  2n  to  n  when  e  -  0.  It  proves 
convenient  to  distinguish  the  following  hierarchy  of  cases; 
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CASE  0:r=n,Q>0; 

CASE  1:   r  <  n  ,   b'^QB  >  0  ;  k_l   ,  , 

CASE  k:   r  <  n  ,   B  A^  QA"b  =  0  ,  m<k-l,   B  A    QA   B>0 


This  list  is  not  exhaustive,  but  serves  to  Illustrate  the 
principal  variations  of  behavior.   Case  0  is  unusual  in 
practice,  so  v;e  shall  concentrate  on  CASE  1  and  higher  cases. 

CASE  1 

In  CASE  1  let  us  seek  an  asymptotic  expansion  in  the  form 


X  =  X(t,e)  +  m(T,e)  +  c  n(a,G) 
p  =  P(t,c)  +ef(T,e)  +  e^g(a,c)  , 


(5) 


where  each  term  is  to  be  represented  by  a  series  in  powers  of 
e.   Here  (X,P)  is  the  outer  solution,  v/hile  (m,ef)  and  (n,£  g) 
are  Initial  and  terminal  boundary  layer  corrections  in  the 
stretched  time  coordinates 

,-  -  t     „  -  1-t 
e  *        e 

The  boundary  layer  corrections  are  required  because  it  is  not 
possible  to  satisfy  all  the  boundary  conditions  using  the  outer 
outer  expansion  by  itself,  as  v;ill  appear. 

Suppose  that  the  outer  solution  is  represented  as 

X(t,c)  =  I     X.c^    ,   P(t,e)  =  I     ?.c^  (6) 

j  =  0  '^  j  =  0  J 

Then,  equating  like  powers  of  e,  v;e  find  that 

-IT  -T  T 

B  R  B  Pq  =  0  ,    BR  -^B  P^  =  0  . 

T 

Multiplying  on  the  left  by  B  ,  since  R  is  positive  definite,  it 

follows  that 

b^Pq  =  0  ,   b'^p^  =  0      ■       (7) 

Then  we   find   that 

X.    =      AX .    +   BU  (8a) 

Pj    =   -QX.    -    a'^Pj      '  (8b) 


where 


Thus  for  each  j,  U.  must  be  such  that  the  constraint 

B^Pj  =  -  RUj.2  (9) 

is  satisfied.   This  constraint  confines  the  solution  of  (8)  to 
a  subspace,  so  that  tlic  outer  solution  cannot  satisfy  all  the 
boundary  conditions  of  (^).   The  unsatisfied  conditions  are 


eliminated  by  the  boundary  layer  corrections 


In  order  to  express  the  constraint  (9)  in  a  convenient 
manner  we  define  the  matrix 


Then 


E  =  I  -  B(b'^QB)  -^b'^Q 
E  B  =  0  ,    b'^Q  E  =  0  ,    E^  =  E  . 


(10) 
(11) 


We  can  now  set 


where 


V.  =  (b'^qb)~^b'^qx.  ,   z.  =  -(b'^qb)~-^ru._2 


(12) 


Multiplying  (8b)  on  the  left  by  B  ,  it  follows  from  (9)  that 

« 

RU. 


whence 


T        T  T 
'■J-2  =  B  QBVj  f  B^A^Pj 


V   =  -(B  QB)~  (B  A  E  P.+  B  A  QBZ.-  RU,  „) 
J  J  J     J  ~  ^ 


Substituting  in    (8)    we    find   that 


(13) 


where 


%7    (E    X.)  =      AEX.    -    G   E^'^P.    -   H. 
d       /    T      ^  ^  '  -^T   T 

at  (e'^Pj  )  =  -QE^^j  -  A  E^f  J  -  i^j 

A   =   EAE    ,         G   =   EAB(B   QB)      B   A  E       , 


(1^) 


Q   =   E   QE    >    0 
and  the    forcing   terms    are 

H,    =   EAB(b'^QB)~^(b'^a'^QBZ.-    RU._p) 

m     m 

K,    =   E   A   QBZ. 

Equations  (1^)  form  a  Hamiltonian  system  which  can  be  solved 
for  EX,  e'^P  with  EX(0),  E^pd)  prescribed  (Bucy,  1967). 
.  Then  since   V,-  is  determined  by  (13)  >  it  follows  from  (12) 
that  X.   satisfies  the  constraint 


T       T 
B  QX,  =  B^QBV. 

It  follov;s  from  the  linearity  of  the  system  that  the 
boundary  layer  corrections  must  also  satisfy  {^) .    Thus 

^  =   eAm  -  BR-^B^f 

df  T 

oi  =  _  Qm  -  eA'f 


(15) 


(16) 


where  m  and  f  ->-  0  as  t  -»•  «>.   Suppose  that  m  and  f  are  expanded 
as 


y 


m(T,e)  =  I     m.cJ  ,   f(T,e)  =  I  f.e^    ,    (17) 
J  =  0  -J  'J  =  0  J 

Then,  equating  like  powers  of  e ,  wo  find  that 

:^  =  -  BR~-^B^f,  +  A  m,  ,  (l8a) 


dT      --  -  -J   "  -j_i 
df/  ,p 


=  -  Q  m,     -  A^f,  ,  (l8b) 


di      "^  '"j       "  ^j-1  _ 
where  ^.  .        ,' ' 

"^-1  =  ^-1  =  ° 

Combinlns  (l8a)  and  (l8b),  v;e  seek  decaying  solutions  of 

d^m, 


^  =  B  R~-'-B'^Qrn,  +  h.  ,     .   -   ■   "  (19) 


where 
Let 

v/here 
Then' 


dx2  ^  f    J-1 

dm.  ,      _-  ^  rp 

h.  1  =  A  .i        +  B  R  -^B^A^f,  , 
J-1      dT  j-1 

m.  =  Em  +  B  R""""^^!-!.  (20) 

■   M.  =  R-'-/^(B'^QB)"-'-B'^Qm   .  .  .  ■• 


,2 

-^  Em,  =  E  h,_,(T)     "         •  .  .  (21) 
and  dT    "J      ^   -^  '   ■    . 

2 

-^  M.  =  R'^^^b'^Q  B  R~-^^^M,+  R-^^^(B^QB)~^B'^Qh,  ,    (22) 
dT   '^  '   "^  .    ^~-^ 

Equation  (21)  has  the  decaying  particular  integral  •• 

»        CO 

Em  =  J  dr  |Eh._j^(s)  ds  ,  (23) 

T    r  .     ' 

Thus      E  m.(0)   is  determined.   In  particular  Em  (0)  =  0. 
The  homogeneous  part  of  equation  (22)  has  the  decaying  solution 

M  =  e"^^  M  (0)  (2il) 

v/here  '^        "^ 


c  =  A  ■^/^b'^qbr"-^'^^ 


from  v;hlch  decaying  particular  integrals  can  be  constructed  by 
integration  for  arbitrary  M,(0).'' 

J 

Now  to  match  the  initial  conditions  of  ('0  we  have 

m„(0)  +  X„(0)  -  x(0) 
whence  ^       ^ 

EXq(O)  =  Ex(0) 

providing  the  Initial  condition  for  (I'l).   Also 


■  1 " 

B  Q  X^(0)  Is  then  determined  by  (15),  so  m„(0)  must  be  such 


that 


0 
b'^QiDqCO)  =  b'^Q(x(0)  -  Xq(0)) 


According  to  (20)   this  will  be  the  case  if 

Mq(0)  =  R^/^(B^QB)~Vq(x(0)-Xq(0)) 

providing  the  initial  condition  for  the  leading  term  of  the 
boundary  layer.   For  the  higher  terms  the  initial  conditions 
are  split  in  a  similar  manner.   Since   E  m.(0)  is  uniquely 
determined  by  the  requirement  for  a  decaying  boundary  layer, 
we  have 

EXj(O)  =  -  Em  (0)  ,     j  >  0  . 

T 
Then  B  QX. (O)  is  determined,  and  hence  the  initial  value  M.(0) 

for  the  part  of  the  boundary  layer  correction  lying  in  the"^ 

range  space  of  B. 

The  terminal  boundary  layer  correction  can  be  determined 
in  a  similar  manner.   Setting 


we  find  that 


1  1 

n(a,e)  =  I     n  e^  ,   g(o,c)  =  I     g  e^ 

j  =  0  J 


(25) 


J  =  0 


^  =  BR  -"b  g,  -  An.  -, 
da  ^j     j-1 


dg 


da 


i  =  Qn.  +  A*^  g 


(26) 


J-1 


Then 


where 


d^g 

^i         -IT 

2^  =  Q  B  R  -"b  gj  +  k._^ 


(27) 


da 
h 


Now  v;e  set 


where 


J-1 


g. 


=  A 


T  ^^.1-1  _ 
dT 


Q  A  n 


J-1 


Then  (27)  implies  that 


da 


E^g.    +  Q  B  R  -'■^^G, 
R-'-/^(B^QB)~^B^g,  . 


T      T 
E  g.  =  E  k^._, 


(28) 


and 


d^G 


da 


E- 


=  R'-'-'^^b'^Q  B  R~^^^G.+  R^^^(b'^Q  B)  ■'■B'^k 

^T 


J-1 


(29) 


(30) 


or  a  decaying  solution  E  g.(0)niis  determined,  and  hence 

■••P.d)  is  determined.   Alsi   B  P.(l)  is  determined,  providing 

the"^  terminal  value  0.(0).        "^ 

J 

Thus  the  complete  asymptotic  solution  can  be  determined 


') 


term  by  terra.   V/e  observe  that  the  leading  term  of  the  outer 
'expansion  is  just  the  familiar  solution  for  a  singular  arc 

which  occurs  when  e  =  0  (Moylan  and  Moore,  1971)-   We  also  note 
■that  near  t  =  0   the  dominant  term  of  the  control  Is 

(l/e)R~-'-B^fQ  ,  where 

B  R'^B^f^  =  -  B  R~^/^  :r^  =   B   R"^/^C  e~^'^M^(0)  .   ' 
Thus  near  t  =  0  the  control  has  the  form 

In  the  limit   as   e  ->  0   this  reduces  to  the  Impulse  v;hich  is 
required  to  make  the  initial  transfer  to  a  singular  arc. 

HIGHER  CASES'  ' 

In  CASE  2  we  note  that  since   Q  >  0   the  condition 

T 
B  Q  B  =  0 

implies  that  .  '  .    , 

Q  B  =  0  .-..'• 

The  appropriate  stretching  for  the  initial  boundary  layer 
correction  proves  to  be   t  =  t/y,  where  y  =  l//c.    ,  Expanding 
the  outer  solution  as 

CO  •  CO 

x(t,y)  =  I  xy  ,    p(t,y)  =  I  ?y 

equations    (8)   hold,   where   now 

.  _  •  b'^Pj    =   R  U^_^    ,  -Uj    =    0    ,    j    <    0    .  (31) 

Then    (8b)    gives  ;        •         ' 

bVPj    =   R  \J._^  '  '  (32) 

The    additional    constraint    (32)    confines    the    outer   solution   to 
a  smaller   subspace.      Consequently   a  transfer   through   the   space 
spanned  by   the    columns    of  B,    AB      must   be    accomplished   in   the 
initial  boundary   layer.      If  the    corrections   to   x  and  p  have 
the    form 


-m(T,y)    =   -     I     my    ,        yf(T,y)    =   y      I      f^ 
we    find   that 


dm.  T    T  T  ^"^i-i 

— 5^  =    B   R~-^B   A    f,    +    A  -    J    ^ 

d     f  ^    df 

dx' 


o-=-QAm.-A         , 
2  ^  J  dT 


The  leading  term  satisfies  the  homogeneous  equation 

0      -ITT 
— jp  =-B  R  ^B  A  Q  A  B  m 

dT 


C. 


with  the  decaying  solution 

where  Z  is  a  constant  matrix, 

1+i  . 


P  =  - 


/2 


and 


=   yfi-l^^gT^T   ^  3  ^-1/2 


Then  m, (t)  lies  in  the  space  spanned  by  the  columns  of  B,  AB 
and  can  be  used  to  match  the  boundary  conditions  at  t  =  0. 
Near  t  =  0  the  dominant  term  is  (l/ij)m_.   Thus  x  makes  an 
excursion  in  the  range  space  of  B,  which  approaches  the  form 
of  a  delta  function  as  y  -»■  0. 

For  CASE  k  we  find  similarly  that  the  appropriate  expan- 
sions are  in  powers  of   y  =  e-*-'^,   where  the  stretching  for  the 
the  initial  boundary  layer  is   x  =  t/y.   Now  B-'-aT  P,  is 

J 

constrained  for  m  <  k,  confining  the  outer  solution  to  a 
progressively  smaller  subspace  v;ith  increasing  k.   The  initial 
boundary  layer  correction  has  to  meet  the  boundary  conditions 
in  the  space  spanned  by  the  columns  of  the  first  k  partitions 
of  the  controllability  matrix 

[b,ab,  ...  a'^"-'-b] 

and  X  makes  an  excursion  in  the  space  spanned  by  the  columns  of 

the  first  k-1   partitions.   Thus  the  increasing  thickness   of 

the  boundary  layer  corresponds  to  the  additional  v;ork  required 

from  the  initial  control.   In  the  limAt  the  control  has 

a  form   corresponding  to  a  delta  function  and  its  first  k-1 

derivatives. 
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